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ABSTRACT: 

PROBLEM TO BE SOLVED: To enable even handicapped person in eyesight to execute the 
selection operation of a window and an icon by cutputting information such as the icon and the 
like in a multi-window system with sound and Braille. SOLUTION: Screen layout information 
transmitted from an application 2 to an operating system 3 is hooked by a screen layout 
information preservation means 9 in a sound/Braille output means 7 and it is stored in a buffer for 
screen layout information preservation 1 0. A screen layout information read means reads screen 
layout information of the buffer 10 whenever an output operation part 6 detects the depression of 
a control key, and transmits it to a screen layout information analysis means 13. The analysis 
means 1 3 analyzes screen layout information and outputs a data string. A voice/Braille data 
conversion/buzzer control part 1 1 converts the data string into voice/Braille, outputs it to a 
speaker/sound synthesis device/Braille display device 12 and informs a user of a window, the 
name of the icon, a coordinate and a distance with voice and Braille. 
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